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DETAILED ACTION 

Response to Arguments 

On pages 9-1 1 , applicant argues that Sankrithi fails to disclose removing 
obstructions without interfering with the field of view of the sensor. While the applicant's 
points are understood, the examiner respectfully disagrees. See for example Sankrithi 
column 9, lines 8-15. There Sankrithi discloses using a cleaning solution of air with 
either water, antifreeze, or a cleaning solution. By using air with the clear liquids such 
as water, Sankrithi is cleaning the sensor without interfering with the field of view of the 
sensor. Therefore the rejection has been maintained. 

On pages 11-14, applicant argues that Sankrithi fails to disclose that the window 
and display device show different portions of the scene. While the applicant's points are 
understood, the examiner respectfully disagrees. The examiner notes that showing 
another portion of the same scene is not found in the claim. What is found in the claim 
is showing another portion of the scene. Sankrithi illustrates in figure 6A multiple 
displays showing different portions of a scene. Therefore the rejection has been 
maintained. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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1 . Claims 1 -1 5 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Sankrithi et al. (6405975), (hereinafter referred to as "Sankrithi") in view of 
Ramachandran et al. (6259475), (hereinafter referred to as "Ramachandran"). 

Regarding claim 1 , Sankrithi discloses an apparatus that relates to 
airplane ground maneuvering systems (Sankrithi: column 1, lines 12-13). This 
apparatus comprises "at least one sensor operable to capture images 
representing scenery outside the vehicle" (Sankrithi: column 3, lines 53-55, 
wherein the sensor is the camera), "a protective housing enclosing the sensor, 
wherein the housing further comprises a transparent aperture through which the 
sensor captures images" (Sankrithi: column 9, lines 1-15, wherein the aperture is 
the clear lens), "a cleaning mechanism operable to remove obstructions from the 
aperture without interfering with the field of view of the sensor" (Sankrithi: 
column 9, lines 1 -1 5, wherein the window cleaning is the cleaning mechanism), 
and "an operator display through which images representing the scenery outside 
the vehicle are displayed" (Sankrithi: figure 6A). However, Sankrithi fails to 
disclose the rotating transparent conical surface as claimed. Ramachandran 
teaches that prior art vehicle camera systems require enclosures that are of 
significant size (Ramachandran: column 2, lines 26-30). To help alleviate this 
problem, Ramachandran discloses "a rotating conical surface" (Ramachandran: 
figures 13-14; column 15, lines 31-42, wherein the rotation is the rotation 
performed by the motor and rings). Therefore, it would have been obvious to one 
having ordinary skill in the art at the time the invention was made to take the 
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apparatus disclosed by Sankrithi and add the conical surface taught by 
Ramachandran in order to obtain an apparatus that helps reduce the size of 
vehicle camera systems. 

Regarding claim 2, Sankrithi discloses "wherein the sensor comprises a 
camera" (Sankrithi: column 3, lines 53-55). 

Regarding claim 3, Sankrithi in view of Ramachandran disclose "wherein 
an outer surface is wiped within the housing to remove obstructions" (Sankrithi: 
column 9, lines 10-15, wherein the wiping is performed by the rubbery squeegee; 
Ramachandran: figures 13-14; column 15, lines 31-42). 

Regarding claim 4, Sankrithi discloses "the cleaning mechanism is located 
to not obstruct the sensors field of view" (Sankrithi: figure 1 1 ; column 9, lines 1 - 
15, wherein the wiper housing 452 is mounted to the plane away from the 
camera). 

Regarding claim 5, Sankrithi discloses "the camera further comprises an 
infrared camera" (Sankrithi: column 13, lines 43-46). 

Regarding claim 6, Ramachandran discloses "the cleaning mechanism 
further comprises a mechanical brush" (Ramachandran: column 15, lines 44-49, 
wherein the mechanical brush is the wiper. The wiper is mechanically moved by 
a motor to brush or wipe the surface). 

Regarding claim 7, Sankrithi discloses "the cleaning mechanism 
comprises a cleaning fluid applicator that applies cleaning solution to the 
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aperture" (Sankrithi: column 9, lines 10-15, wherein the cleaning solution is the 
combination of the air mixed with water, antifreeze, or cleaning solution). 

Regarding claim 8, note the examiners rejection for claim 1, and in 
addition Sankrithi discloses "images representing scenery outside the vehicle are 
derived from captured images from the sensor" (Sankrithi: column 3, lines 53-55, 
wherein the camera derives the images). 

Regarding claim 9, note the examiners rejection for claim 2. 

Regarding claim 10, Sankrithi discloses "the vehicle comprises an aircraft" 
(Sankrithi: column 3, lines 44-47). 

Regarding claim 1 1 , note the examiners rejection for claim 5. 

Regarding claim 12, note the examiners rejection for claim 6. 

Regarding claim 13, note the examiners rejection for claim 7. 

Regarding claim 14, note the examiners rejection for claim 1, and in 
addition, Sankrithi discloses "sending images of a portion of the out-the-window 
scene from the viewpoint of the sensor" (Sankrithi: figure 6A, wherein the 
images are sent to the display) and "outputting image of the scenery outside the 
vehicle to a first display, wherein the display device is positioned to provide the 
portion of a desired out-the window visual scene in combination with a window 
that provides another portion of the desired out-the-window visual scene" 
(Sankrithi: figure 6A, wherein multiple views are displayed to the user). 

Regarding claim 15, although not disclosed, it would have been obvious to 
mount the second camera within a protective housing (Official Notice). Doing so 
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would have been obvious in order to protect the camera against the influence of 
outside elements. 

2. Claims 1 6-33 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Sankrithi et al. (6405975), (hereinafter referred to as "Sankrithi") in view of 
Ramachandran et al. (6259475), (hereinafter referred to as "Ramachandran") in further 
view of Jamieson et al. (6665063), (hereinafter referred to as "Jamieson"). 

Regarding claim 16, note the examiners rejection for claim 1, and in 
addition, claim 16 differs from claim 1 in that claim 16 further requires fusing two 
image together. Jamieson teaches that for manned aircraft, collisions with 
ground and air based obstacles results in numerous fatalities each year 
(Jamieson: column 2, lines 32-35). To help alleviate this problem, Jamieson 
discloses "images from the first and second sensor are fused to create a first 
fused image" (Jamieson: figures 13A and 14A, wherein the images are fused or 
combined to produce the output image). Therefore, it would have been obvious 
to one having ordinary skill in the art at the time the invention was made to take 
the apparatus disclosed by Sankrithi and add the processing taught by Jamieson 
in order to obtain an apparatus that helps prevent aircraft collisions. 

Regarding claim 17, Jamieson discloses "combining the fused image with 
symbols representing objects" (Jamieson: figures 13A and 14A, wherein the 
symbols are the circles and lines representing objects). 
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Regarding claim 18, Jamieson discloses "fusing the first fused image with 
an enhanced image from at least one of RADAR and a FLIR sensor" (Jamieson: 
column 16, lines 5-10). 

Regarding claim 19, note the examiners rejection for claims 1 and 14, and 
in addition Sankrithi in view of Jamieson disclose "transform the first sensor 
image to a viewpoint image from an operator station in the device, wherein the 
viewpoint image is seized and oriented to conform to the scenery outside the 
device from the operator station" (Sankrithi: figures 16A and 16B, wherein the 
image is defined within the field of view and oriented to fit the display; Jamieson: 
figures 13A and 14A). 

Regarding claim 20, Jamieson discloses "the symbols represent 
information regarding the operation state of the device and the moving objects 
detected in the image" (Jamieson: column 16, lines 25-30, wherein the operation 
state information is the velocity, speed, and heading; column 16, lines 31-35, 
wherein the distance to the object is displayed). 

Regarding claim 21 , note the examiners rejection for claim 20. 

Regarding claim 22, although not disclosed, it would have been obvious to 
generate a symbol representing weather hazards (Official Notice). Doing so 
would have been obvious in order to more easily warn the pilot of adverse 
weather conditions. 
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Regarding claim 23, Jamieson discloses "receive an enhanced image in 
low-visibility conditions" (Jamieson: column 16, lines 5-10, wherein the RADAR 
or FLIR provide the image in low-visibility conditions). 

Regarding claim 24, Jamieson discloses "fuse the viewpoint image with 
the enhanced image" (Jamieson: figures 13A and 14A). 

Regarding claim 25, Jamieson discloses "utilize data from a position 
sensor to determine the location of the objects" (Jamieson: column 16, lines 31- 
35, wherein the location of the object is determined with respect to the aircraft). 

Regarding claim 26, Jamieson discloses "utilize data form off-board data 
sources regarding the objects" (Jamieson: figure 36, wherein the 
transmit/receive fiber bundles receive off-board data). 

Regarding claim 27, note the examiners rejection for claim 2. 

Regarding claims 28-29, Jamieson discloses the sensor is a RADAR and 
FLIR sensor" (Jamieson: column 16, lines 5-10). 

Regarding claim 30, Sankrithi discloses "generate a common display area 
associated with two mutually exclusive windows of information on the display 
device, the area being customized by the operator to display detailed 
information" (Sankrithi: figure 6A; column 6, lines 23-25, wherein the knob 
adjusts the displays). 

Regarding claim 31 , note the examiners rejection for claims 1,14, and 1 5, 
and in addition Sankrithi discloses "first and second display devices" (Sankrithi: 
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figure 6A), "outputting the two viewpoints to the first and second display devices" 
(Sankrithi: figure 6A). 

Regarding claim 32, Jamieson discloses "combining the image with 
symbols representing the objects and primary flight information" (Jamieson: 
column 16, lines 25-30, wherein the primary flight information is the velocity, 
speed, heading, and power levels). 

Regarding claim 33, note the examiners rejection for claim 18. 
Conclusion 

1 . THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to DAVID CZEKAJ whose telephone number is (571)272- 
7327. The examiner can normally be reached on Mon-Thurs and every other Friday. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on (571) 272-7418. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Dave Czekaj/ 
Art Unit 2621 



/Mehrdad Dastouri/ 

Supervisory Patent Examiner, Art Unit 2621 



